Adaptive Multi-Fidelity Modeling for Efficient Design Exploration Under Uncertainty

This thesis work introduces a novel multi-fidelity modeling framework, which is designed to address the practical challenges encountered in Aerospace vehicle design when 1) multiple low-fidelity models exist, 2) each low-fidelity model may only be correlated with the high-fidelity model in part of the design domain, and 3) models may contain noise or uncertainty. The proposed approach approximates a high-fidelity model by consolidating multiple low-fidelity models using the localized Galerkin formulation. Also, two adaptive sampling methods are developed to efficiently construct an accurate model. The first acquisition formulation, expected effectiveness, searches for the global optimum and is useful for modeling engineering objectives. The second acquisition formulation, expected usefulness, identifies feasible design domains and is useful for constrained design exploration. The proposed methods can be applied to any engineering systems with complex and demanding simulation models

Epistemic Modeling Uncertainty of Rapid Neural Network Ensembles for Adaptive Learning

Emulator embedded neural networks, which are a type of physics informed neural network, leverage multi-fidelity data sources for efficient design exploration of aerospace engineering systems. Multiple realizations of the neural network models are trained with different random initializations. The ensemble of model realizations is used to assess epistemic modeling uncertainty caused due to lack of training samples. This uncertainty estimation is crucial information for successful goal-oriented adaptive learning in an aerospace system design exploration. However, the costs of training the ensemble models often become prohibitive and pose a computational challenge, especially when the models are not trained in parallel during adaptive learning. In this work, a new type of emulator embedded neural network is presented using the rapid neural network paradigm. Unlike the conventional neural network training that optimizes the weights and biases of all the network layers by using gradient-based backpropagation, rapid neural network training adjusts only the last layer connection weights by applying a linear regression technique. It is found that the proposed emulator embedded neural network trains near-instantaneously, typically without loss of prediction accuracy. The proposed method is demonstrated on multiple analytical examples, as well as an aerospace flight parameter study of a generic hypersonic vehicle

Epistemic Modeling Uncertainty of Rapid Neural Network Ensembles for Adaptive Learning

Emulator embedded neural networks, which are a type of physics informed neural network, leverage multi-fidelity data sources for efficient design exploration of aerospace engineering systems. Multiple realizations of the neural network models are trained with different random initializations. The ensemble of model realizations is used to assess epistemic modeling uncertainty caused due to lack of training samples. This uncertainty estimation is crucial information for successful goal-oriented adaptive learning in an aerospace system design exploration. However, the costs of training the ensemble models often become prohibitive and pose a computational challenge, especially when the models are not trained in parallel during adaptive learning. In this work, a new type of emulator embedded neural network is presented using the rapid neural network paradigm. Unlike the conventional neural network training that optimizes the weights and biases of all the network layers by using gradient-based backpropagation, rapid neural network training adjusts only the last layer connection weights by applying a linear regression technique. It is found that the proposed emulator embedded neural network trains near-instantaneously, typically without loss of prediction accuracy. The proposed method is demonstrated on multiple analytical examples, as well as an aerospace flight parameter study of a generic hypersonic vehicle